METHOD OF VARYING THE BIT RATE OF THE 
DATA STREAM OF CODED VIDEO PICTURES 

Field, of the Invention 

The present invention relates in general to 
the processing of digitized pictures, and, in 
particular, to a technique for varying the bit-rate of 
5 a data stream of digitized video pictures. 

The present invention is also applicable to 
processing systems of coded video pictures. Due to 
the particular importance of the MPEG standard in 
treating digitized video sequences, reference will be 
10 made to an MPEG2 system for illustrating application of 
the present invention. In addition to an MPEG2 system, 
the method of the invention may also be used in 
processing systems that transfer video sequences based 
on other type standards. 

15 

Background of the Invention 

Video coding according to the MPEG2 standard 
will be discussed below. The MPEG (Moving Pictures 
Experts Group) standard defines a set of algorithms 
20 dedicated to the compression of sequences of digitized 
pictures. These techniques are based on the reduction 
of the spatial and temporal redundance of the sequence. 
Reduction of spatial redundance is achieved by 
compressing independently the single images using 
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quantization, discrete cosine transforms (DCT) and 
Huffman coding. 

The reduction of temporal redundance is 
obtained using the correlation that exist between 
5 successive pictures of a sequence. Approximately each 
image can be expressed locally as a translation of a 
preceding and/or successive image of the sequence. To 
this end, the MPEG standard uses three kinds of 
pictures, indicated with an I (Intra Coded Frame) , P 

10 (Predicted Frame) and B (Bidirectionally Predicted 
Frame) . The I pictures are coded in a fully 
independent mode. The P pictures are coded with 
respect to a preceding I or P picture in the sequence. 
The B pictures are coded with respect to two pictures, 

15 an I or P kind, with the preceding one and the 
following one in the video sequence (Figure 1) . 

A typical sequence of pictures may be as 
follows: IBBPBBPBBIB... This is the order in 
which they will be viewed. However, given that any P 

20 is coded with respect to the preceding I or P, and any 
B is coded with respect to the preceding and following 
I or P, it is necessary that the decoder receive the P 
pictures before the B pictures, and the I pictures 
before the P pictures. Therefore, the order of 

25 transmission of the pictures will be IPBBPBBIB 
B . . . 

Pictures are processed by the coder 
sequentially in the indicated order, and are 
successively sent to a decoder which decodes and 

30 reorders them, thus allowing their successive 

displaying. To code a B picture it is necessary for 
the coder to keep in a dedicated memory buffer, called 
a frame memory, the I and P pictures coded and 
thereafter decoded, to which current B picture refers. 

35 This requires an appropriate memory capacity. 
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One of the most important concepts in coding 
is motion estimation. Motion estimation is based on 
the following consideration. A set of pixels of a frame 
of a picture may be placed in a position of a successive 
5 picture obtained by translating the preceding one. These 
transpositions of objects may expose parts that were not 
visible before as well as changes of their shape, e.g., 
during a zooming . 

The family of algorithms suitable to identify 

10 and associate these portions of pictures is generally 

referred to as motion estimation. Such an association of 
pixels is instrumental to calculate a difference picture, 
thus removing redundant temporal information and making 
more effective the successive processes of DCT 

15 compression, quantization and entropic coding. 

A typical example of a method using the 
standard MPEG2 will now be discussed. A block diagram of 
a video MPEG2 coder is depicted in Figure 2. Such a 
system is formed by the following functional blocks. 

2 0 Chroma filter block from 4:2:2 to 4:2:0. In 

this block there is a low pass filter operating on the 
chrominance component which allows the substitution of 
any pixel with the weighed sum of neighboring pixels 
placed on the same column and multiplied by appropriate 

25 coefficients. This allows a successive subsampling by 
two, thus obtaining a halved vertical definition of the 
chrominance . 

Frame ordinator. This blocks is composed of 
one or several frame memories outputting the frames in 

30 the coding order required by the MPEG standard. For 

example, if the input sequence isIBBPBBP etc., the 
output order will belPBBPBB... The Intra coded 
picture I is a frame or a semi-frame containing temporal 
redundance. The Predicted-picture P is a frame or semi- 

35 frame from which the temporal redundance with respect to 
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the preceding I or P (precedingly coded/decoded) has been 
removed. The Biredictionally predicted-picture B is a 
frame or a semi-frame whose temporal redundance with 
respect to the preceding I and successive P (or preceding 
5 P and successive I) has been removed. In both cases the 
I and P pictures must be considered as already 
coded/decoded . 

Estimator. This is the block that removes the 
temporal redundance from the P and B pictures. 

10 DCT. This is the block that implements the 

discrete cosine transform according to the MPEG2 
standard. The I picture and the error pictures P and B 
are divided in blocks of 8*8 pixels Y, U, and V on which 
the DCT transform is performed. 

15 Quantizer Q. An 8*8 block resulting from the 

DCT transform is then divided by a quantizing matrix to 
reduce the magnitude of the DCT coefficients. In such a 
case, the information associated to the highest 
frequencies which are less visible to human sight tend to 

20 be removed. The result is reordered and sent to the 
successive block. 

Variable Length Coding (VLC) . The codification 
words output from the quantizer tend to contain a large 
number of null coefficients followed by non-null values. 

25 The null values preceding the first non-null value are 

counted and the count figure forms the first portion of a 
codification word, and the second portion of which 
represents the non-null coefficient. 

These pairs tend to assume values more probable 

30 than others. The most probable ones are coded with 

relatively short words composed of 2, 3 or 4 bits while 
the least probable are coded with longer words. 
Statistically, the number of output bits is less than in 
the case such a criterion is not implemented. 
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Multiplexer and buffer. Data generated by the 
variable length coder, i.e., the quantizing matrices, the 
motion vectors and other syntactic elements are assembled 
for constructing the final syntax considered by the MPEG2 
5 standard. The resulting bit stream is stored in a memory 
buffer, the limit size of which is defined by the MPEG2 
standard requirement that the buffer cannot be over 
filed. The quantizer block Q supports such a limit by 
making the division of the DCT 8*8 blocks dependent upon 
10 on how far the system is from the filling limit of such a 
memory buffer, and on the energy of the 8*8 source block 
taken upstream of the motion estimation and DCT transform 
steps . 

Inverse Variable Length Coding (I-VLC) . The 

15 variable length coding functions specified above are 
executed in an inverse order. 

Inverse Quantization (IQ) . The words output 
by the I-VLC block are reordered in the 8*8 block 
structure, which is multiplied by the same quantizing 

20 matrix that was used for its preceding coding. 

Inverse DCT (I-DCT) . The DCT transform 
function is inverted and applied to the 8*8 block 
output by the inverse quantization process- This 
permits passing from the domain of spatial frequencies 

25 to the pixel domain. 

Motion Compensation and Storage. At the 
output of the I-DCT, one of the following two items may 
exist. A decoded I frame (or semiframe) that must be 
stored in a respective memory buffer for removing the 

30 temporal redundance with respect thereto from 

successive P and B pictures. A decoded prediction 
error frame (or semiframe) P or B that must be summed 
to the information precedingly removed during the 
motion estimation phase. In case of a P picture, such 

35 a resulting sum which may be stored in dedicated memory 
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buffer is used during the motion estimation process for 
the successive P pictures and B pictures. These frame 
memories are distinct from the frame memories that are 
used for re-arranging the blocks. 
5 The MPEG2 decoding will be explained by 

referring to Figure 3. The first I picture received is 
decoded by detecting the headers in the bitstream by 
the following: a HEADER-DETECTION block, a successive 
inverse VLC decoding, an inverse decoding of the run- 

10 level pairs, an inverse quantization, an inverse DCT 
computation and the successive storing in suitable 
memory buffers, and used to calculate the prediction 
error for decoding the successive P and B pictures. 

In video broadcasting, the sequences are 

15 transmitted or are eventually recorded on a variety of 
channels and supports, each with its own capacity, 
speed and cost. Distribution of a film, starting from 
a master recording, may be made on a DVD (Digital Video 
Disk) or via satellite or cable. The available 

20 transmission band may be different from the one 
allocated during the coding phase of the video 
sequence. This raises the problem of re-adapting to 
the characteristics of new media a bitstream belonging 
to video pictures originally coded for a channel with a 

25 different bit-rate. 

More specifically, this implies the need to 
modify the bit-rate Bl of a MPEG2 bitstream, expressed 
in Bl Mbit/s, and is generated after a coding of the 
source sequence in a bitstream still coherent to a 

30 MPEG2 syntax, with a B2 bit-rate, where B2 is different 
from Bl. The bit-rate Bl is a bandwidth measure of the 
available channel. Such a change of bit-rate may be 
effected in a very straight forward manner without 
using dedicated devices. 



Since an encoder and a decoder transform 
respectively a sequence of photograms into a MPEG2 
bitstream, and a MPEG2 bitstream into decoded pictures 
starting from a bitstream coded with an arbitrary Bl 
bit-rate, it is always possible to obtain a bitstream 
with a B2 bit-rate by simply coupling the output of the 
decoder to the input of the encoder. This is done 
after having programmed the latter in order to code 
with the desired bit-rate B2 . 

This procedure, which may be defined as an 
explicit transcoding of a bitstream, requires the 
following steps: 



1. inverse Huffman coding; 

2. inverse run-length coding; 

3. inverse quantization; 

4. inverse Discrete Cosine Transform; and 

5. motion compensation. 



The above steps 1-5 are carried out in the 
decoder, while the encoder performs the following 
steps : 



1 . 


pre-processing; 


2. 


motion estimation; 


3. 


calculation of the prediction error; 


4 . 


Discrete Cosine Transform; 


5. 


quantization; 


6. 


run-length coding; 


7. 


Huffman coding; 


8 . 


inverse quantization; 


9. 


inverse discrete cosine transform; and 


10. 


motion-compensation . 
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As it may be easily discerned, such a 
transcoding process entails a very complex 
computational complexity. The major computational 
burden of the above noted sequences dwells in the 
5 motion estimation step in the direct /inverse cosine 
transform steps and in the motion compensation step. 
In contrast, quantization, run-length coding and 
Huffman coding are relatively less demanding steps. 

There is a need for a method of changing the 
10 bit-rate of a data stream of video pictures that is 
relatively easier to implement in hardware form and 
does not require burdensome calculations. 

Summary of the Invention 

In view of the foregoing background, it is 

15 therefore an object of the present invention to change 
the bit-rate of a bitstream of video pictures using a 
reduced number of steps and simplify the required 
hardware resources for doing so. 

This and other objects, features and 

20 advantages in accordance with the present invention are 
provided by a method for producing a bitstream relative 
to digital video pictures subdividible into a pair of 
bitstreams of coded data and control bits, 
respectively, having a bit-rate different from the bit- 

25 rate of an input bitstream. 

This result is obtained by dividing the input 
bitstream into a sequence of data and into a sequence 
of control bits, and modifying the sequence of control 
bits obtained as a function of the different bit-rate 

30 to be output for producing an output sequence of 

control bits. The method further includes decoding the 
sequence of coded data producing an intermediate 
sequence of decoded data that is successively quantized 
with a pre-established step and coded for producing an 
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output sequence of coded data. The output data stream 
of the desired bit-rate is produced by merging the two 
output sequences. Optionally, it is possible to 
dequantize the intermediate sequence of decoded data 
5 before carrying out the quantization with the pre- 
established step. 

The method of the invention may be easily 
adapted to pictures coded according to the MPEG2 
standard by making the decoding and coding operations 

10 operate in a Huffman decoding followed by a run-length 
decoding, and in a run-length coding followed by a 
Huffman coding, respectively. The quantization step is 
preferably determined by a feed-back/forward rate 
control technique or by a feed-back/forward rate 

15 control technique. 

A hardware embodiment of this method may 
comprise a first circuit block separating the input 
stream into a sequence of coded data and into a 
sequence of control bits, and a second circuit block 

20 for modifying the sequence of control bits as a 

function of the different bit-rate that is desired for 
producing an output sequence of control bits. The 
hardware embodiment further includes a decoder for the 
sequence of coded data for producing an intermediate 

25 sequence of decoded data, and a quantizer for a pre- 
established step of the intermediate sequence of data. 
An encoder is coupled to the output of the quantizer 
for producing an output sequence of the coded data. A 
third circuit block merges the two output sequences and 

30 outputs a bitstream with the required bit-rate. 

Optionally, the device may include a dequantizer for 
the intermediate sequence of decoded data before the 
quantizer . 
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Brief Description of the Drawings 

The particular aspects and advantages of the 
invention will become even more evident through the 
following description of several embodiments of the 
5 invention and by referring to the attached drawings, 
wherein : 

Figure 1 is a block diagram comparing a known 
coding technique with the method according to the 
present invention; 
10 Figure 2 is a block diagram of an MPEG2 

encoder according to the prior art; 

Figure 3 is a block diagram of an MPEG2 
decoder according to the prior art; 

Figure 4a is a block diagram of an 
15 architecture implementing the method according to the 
present invention; 

Figure 4b illustrates a preferred embodiment 
of the quantization chain according to the present 
invention; 

20 Figure 5 is a block diagram of an 

architecture according to the present invention 
including a control of the feed-back compression rate; 
and 

Figure 6 is a block diagram of an 
25 architecture according to the present invention 

including a control of the feed-forward compression 
rate . 

Detailed Description of the Preferred Embodiments 

The bit-rate is determined by the number of 
30 bits dedicated to the coding of the quantized DCT 

coefficients of the prediction error. By operating on 
the quantization parameter it is possible to increase 
or decrease the bit-rate. The selection of this 
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parameter is made by the control module of the 
compression rate. 

The portions of the bitstream that do not 
influence the reduction of the bit-rate are simply 
5 copied rather than processed. This occurs for the 

majority of the data relative to the syntax and, above 
all, for the motion vectors, because the motion field 
depends solely on the calculations carried out on the 
source sequence. Since the goal is to obtain a 

10 reduction of the bit-rate, the coding process is 

equivalently represented by the VLC inverse coding and 
by the run-length decoding. This is in reference to 
the MPEG2 standard. 

It is not necessary to carry out a discrete 

15 inverse cosine transform and a motion compensation 
because the control of the bit-rate occurs in the 
frequency domain with a net saving of computational 
processing. Once the quantized DCT coefficients are 
extracted, they are requantized with a new quantization 

20 step. This step is typically different from the 
quantization step found in the input (source) 
bitstream, and the run-length and Huffman coding are 
finally performed. 

Optionally, the requantization operation may 

25 be preceded by a de-quantization of the DCT 

coefficients in case it is desired to operate with non 
quantized values. Substantially, the computational 
savings derive from eliminating the motion compensation 
step, the motion estimation step, the direct and 

30 inverse discrete cosine transform steps. 

A comparison of the method of the invention 
and a normal coding technique is illustrated in Figure 
1. With the method of the invention it is possible to 
obtain directly an output data stream at the desired 

35 bit-rate of B2 Mbit/s through the block 
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MPEG2_TRANSC0DER that implements the method of the 
invention. This block processes an input data stream 
having a bit-rate of Bl Mbit/s as produced by an 
MPEG2_ENC0DER that codes according to the MPEG2 
5 standard the pixels of a SOURCE_SEQUENCE . 

The same result may be obtained by connecting 
in cascade an MPEG2_DEC0DER and an MPEG2_ENC0DER . 
However, as shown in Figure 1, such an approach implies 
the generation of a sequence of decoded pictures 

10 DECODED_SEQUENCE with the associated costs in terms of 
processing complexity and time required. 

A basic diagram of a hardware embodiment of 
the method of the invention is shown in Figure 4a. The 
IN PUT_BI STREAM is fed to a circuit block that separates 

15 the headers of the sequence and of the GOP (Group Of 

Pixels), which are successively adapted to the desired 
bit-rate and sent to a multiplexer that produces the 
output bitstream. 

The Picture_Header_Detection block detects the 

20 presence of the control bits of a picture of the video 
sequence, separating them from the data bits that are 
sent to a Requantization_Block. This block carries out 
after the Huffman and run-length decoding process a 
dequantization and a quantization with a pre- 

25 established step, which is followed by a run-length 

coding and a Huffman coding. The step of quantization 
is determined by the Rate_Control and BUP blocks that 
store the number of bits produced. 

A preferred embodiment of the Requantization_ 

30 Block is shown in Figure 4b. The cascade of blocks 
perform the above mentioned Huffman decoding (IVLC) , 
run-length decoding (IRL) and dequantization (IQ) , 
followed by a quantization (Q) with a step determined 
by the Quantization_Parameter, and the run-length (RL) and 

35 Huffman (VLC) coding. 
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The compression rate may be regulated by 
dedicated multiplexers. There are essentially two 
multiplexer types: feed-back rate control and feed- 
back/forward (with pre-analysis ) hybrid rate control. 
5 The MPEG2, Test Model 5, provides a detailed 

description of the above mentioned techniques for 
regulating the compression rate. Other implementations 
of the above noted control techniques are described in 
the following European Patent Applications which are 
10 incorporated herein by reference in their entirety: 
97830591.0, 98830599.1 and 99830560.1. These 
_ applications are assigned to the assignee of the 

gjg present invention. 

s Jf A hardware embodiment of the feed-back 

fU 15 technique of rate control is illustrated in Figure 5. 

'ti The following discussion is provided in reference to 

y3 this figure. Through the input gate 1 the bitstream is 

J"^ transferred to circuit A. The first analysis takes 

H 1 place in this circuit. If data relative to the syntax 

V 20 of the sequence and of the GOP are detected, they are 

O conveyed through circuit path 2 towards circuit B, 

^ which extracts certain format data, and circuit L 

synchronizes the output thereof. 

When circuit A detects the start data of the 
25 picture, circuit C takes control until a new header of 
the sequence/GOP/picture is detected. When circuit A 
starts to transmit picture data, circuit C conveys them 
through circuit D toward the requantization chain of 
circuits E-J. In this phase, circuit K provides the 
30 quantization parameter, and through circuit 7 collects 
information on the past performance of the coding 
process. Circuit L reconstructs the bitstream starting 
from the contribution of circuit 3 (syntax of the 
sequence and of the GOP) , of circuit 5 (motion vectors) 
35 and of circuit 6 (DCT coefficients) . 
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The alternative technique of rate control may 
be implemented by the architecture of Figure 6. The 
following discussion is provided in reference to this 
figure. Through the input gate 1 the bitstream is 
5 conveyed to circuit A. Circuit A carries out a first 
analysis of the bitstream. If data relative to the 
syntax of the sequence and of the GOP are detected, 
they are conveyed through circuit path 2 toward circuit 
B which extracts certain format data, and circuit P 
10 synchronizes the output thereof. When circuit A 

detects the start data of a picture, circuit C takes 
_ control until a new header of the sequence/GOP/picture 

=j3 is detected. 

/: Circuit C controls the timing between the 

fU 15 pre-analysis and the recoding. When circuit A starts 

54 to transmit picture data, circuit C copies the data in 

J3 buffer E and simultaneously conveys such data through 

circuit path 6 towards the requantization chain of 
H* circuits G-L. In this phase, circuit O provides the 

%~ 20 quantization parameter during the preanalysis phase, 

Q and circuit M sends the collected data to circuit N 

" which constructs the Bit Usage Profile of the picture. 

Thereafter, circuit C switches its output 
from circuit D towards circuit F so that the original 
25 data are read again by circuit E and retransmitted to 
the requantization chain. Circuit O supplies the 
quantization parameters of the final coding using the 
data collected by circuit N during the preanalysis. 
Circuit M outputs data towards circuit path 13 and 
30 sends the requantized and coded coefficients to circuit 
P. Circuit C inserts properly the data output by 
circuit M with the original motion vectors stored in 
circuit E during the pre-analysis phase. Circuit P 
reconstructs the bitstream starting from the 
35 contributions of circuit 3 (syntax of sequence and 
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GOP) , of circuit 8 (motion vectors) and of circuit 13 
(DCT coefficients) . 

To further illustrate the functioning of the 
device of Figure 6, reference may be made to the 
5 following representation in a C pseudo-code of the 

procedures performed by the main circuit blocks. It is 
useful to list several functions that are commonly used 
to access the bitstream: such as ShowBitsS(N) and 
ShowBitsC (N) , which show, without moving from the 
10 actual position, the next N bits of the bitstream. The 
first function reads from input 1, and the second 
function reads from the picture memory ( Local_Memory ) . 

Other functions include GetBitsS(N) and 
GetBitsC(N), which show the next N bits of the input 
15 bitstream and of the Local_Memory , respectively. The 
cursor shifts by N positions. The function 
PutBitsD (bits) and PutBit sC (bits ) write the past bits 
by argument in the output bitstream (14) and in the 
Loc al_Memor y , respectively. 
20 The functions MoveBitsSD (N) , MoveBitsSC (N) 

and MoveBitsCD (N) are combinations of GetBits*() and 
PutBits*() functions which allow the reading and moving 
of N bits from the input to the output, from the input 
to the Local_Memory and from the Local_Memory to the 
25 output, respectively. 

The function of circuit blocks [A]+[B] 
include the VideoSequence ( ) procedure that recognizes 
the header sections of the sequence and of GOP, and 
outputs them. When the start code of the picture is 
30 detected, control is passed to circuit C. In 
particular : 

VideoSequence ( ) 
{ 

while (NextStartCode ( ) != SEQUENCE_END_CODE) 
35 { 
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if (SEQUENCE_START_CODE | | GOP_START_CODE ) 
{ 

/* copy input data to output */ 
} 

5 else if (PICTURE_START_CODE) 

{ 

/* [C] */ 
} 

For circuit block C: 
TranscodePictureData ( ) 
{ 

PicturePreanalysis ( ) 
PictureReshape ( ) 
} ' 

In the detail: 
PicturePreanalysis ( ) 
{ 

for(i=0; i<= MACROBLOCK_COUNT; i++) 
{ 

MoveBitsSC (MOTION_VECTORS ) 

mQuant = PreanalysisMQuant ( ) /* rate control [0] */ 
Requantize (DCTMatrix, mQuant) 
BUP[i] = BitCount (DCTMatrix) 
} 

The letter procedure carries out the analysis 
of the picture header, then it begins the macroblock 
loop until the end of the data section of the picture 
30 is reached. The bitstream access functions used in 
this case are the ReadBitsO, PutBitsCO and, above 
all, MoveBitsSC () . This implies that, while the 
bitstream is consumed for performing the preanalysis, 
the read bits are saved in the Local Memory. 
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The Requantizer ( ) function is self- 
explanatory, whereas the BitCount ( ) performs the run- 
length and Huffman coding without writing the result 
but counting only the bits produced. Such a number is 
5 written in the BUP. 

At the end of this procedure the situation is 
as follows. The pointer to the source bitstream is 
positioned at the end of the data section of the 
picture. The pointer to the LOCAL_MEMORY is positioned 
10 at the start of the LOCAL_MEMORY itself, which contains 
a copy of the section of data of the picture just read 
from the source bitstream. In the output file none of 
the bits relative to the picture has been written yet. 

Picture Reshape () 
15 { 

for(i=0; i<= MACROBLOCK_COUNT; i++) 
{ 

MoveBi t sCD (MOTION_VECTORS ) 

mQuant = ReshapeMQuant ( ) /* rate control */ 
20 Requantize ( DCTMatrix, mQuant) 

PutBitsD (DCTMatrix) 
} 
} 

This routine is very similar to a Picture 
25 Preanalysis () , apart from the fact that, the functions 
to access the data become ReadBits(), PutBitsD () and 
MoveBitsCD ( ) . At the end of this procedure the 
situation is as follows. The pointer to the source 
bitstream is set at the end of the data section of the 
30 picture. The pointer to the LOCAL_MEMORY is set at the 
end of the LOCAL_MEMORY itself, which will be 
successively emptied to receive the data belonging to 
the successive picture. The transcoded data of the 
picture have been written in the output file. 
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For circuit block 0: 

PreanalysisMQuant ( ) 
{ 

/* returns previous picture's mean mQuant */ 
5 } 

The pre-analysis quantization parameter 
mQuant is the mean of the coding of the last common 
picture, i.e., of the same type I, P or B. 

10 ReshapeMQuant ( ) 

{ 

LocalError - BITS_PRODUCED-BUP 
IntegralError += LocalError 

mQuant = PREANALYS I S_MQUANT + LocalError*PropCoef f 
15 + IntegralError*IntCoef f 

} 

At each coding step, the Rate_Control circuit 
measures the offset from the ideal profile (LocalError) 
and calculates also the integral error. The mQuant 
20 value is then obtained by applying to the PI controller 
the coefficients PropCoeff and IntCoeff. 



